# Portuguese BERT

BERTugues is a BERT model trained on Portuguese text, strictly following the original BERT paper's pre-training process, completing masked language modeling and next sentence prediction tasks through 1 million training steps.

This model is a fine-tuned version of the Portuguese BERT base model (neuralmind/bert-base-portuguese-cased), with unspecified specific tasks

BERTimbau Large is a pre-trained BERT model for Brazilian Portuguese, achieving state-of-the-art performance on multiple downstream NLP tasks.

This is a compact version of distilbert-base-multilingual-cased, specifically designed for Portuguese, while maintaining the accuracy of the original model.